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Abstract 


Textures provide important characteristics for a large number of applications in image 
processing. The two important characteristics of texture are Coarseness and Directionality. 
Though various statistical and structural techniques have been in use for a long time, the 
multiresolution approach is now being increasingly applied for texture analysis. In mul- 
tiresolution analysis the wavelet theory is an effective tool as it can effectively emulate 
the human visual system . 

In this thesis wavelet packet transform has been applied for texture classification. Two 
approaches have been studied. The Progressive classification approach and the Complete 
Energy Map. It was found that the complete energy map approach gave a 100 % clas- 
sification at level L-1 and L level respectively for an L level decomposition of the given 
image. 

An algorithm for region identification and classification, for multitextured images has been 
proposed. An attempt has been made to combine the region identification and classifica- 
tion of the various textures in an image, by exploiting the wavelet packet energy signatures 
of the textures. As the textures have distinct signatures, the dominant subspaces of a 
texture present in the image are utilized to identify the region of the chosen texture. To 
confirm the correctness of the region, we extract the region and classify it. The advantage 
with this algorithm is that it is computationally simple. In region identification though 
the reconstructed region is of inferior resolution, this algorithm effectively identifies the 
region of the chosen texture if it is present. 
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Chapter 1 


Introduction 


1.1 Importance of Texture Analysis 

Textures are couvsidered to provide important characteristics for surface and object iden- 
tification from aerial photographs, biomedical images and many other type of images. 
Their analysis is fundamental to many applications such as industrial monitoring, remote 
sensing etc. Though a lot of work has been done in the field of texture analysis encom- 
passing the area of .segmentation, classification, feature extraction etc, it is still considered 
an interesting but difficult problem in image processing. 


1.2 Review of Texture Analysis 

Texture is defined as a structure composed of a large number of, more or less, ordered 
similar elements or patterns without any of them drawing special attention and thus 
offering a global unitary impression to the observer. The two major characteristics of 
a texture are COARSENESS and DIRECTIONALITY. The two major texture analysis 
approaches are Statistical and Structural [6]. Texture analysis essentially comprises of 
TextureClassification, Segmentation and Texture Synthesis . 
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1.2.1 Statistical Approach 

On the statistical level Texture is defined by a set of statistics extracted from a large 
ensemble of local picture properties. These properties define the set of primitives for 
texture analysis. 

• Cooccurrence Matrices [8] : The spatial grey level dependence method (SGLDM) 
is based on the estimation of the second order joint conditional probability density 
functions j[i,j\d,6). Each function is the probability of going from grey level i 
to grey level j given the intersample spacing as d and the direction by angle 6. 
The estimated values are written in the form of a cooccurrence matrix. From the 
cooccurrence matrix several textural features like energy, entropy, correlation, local 
homogeneity etc are extracted. 

• Gray Level Difference Method [9] ; Let g{n,m) be the image intensity for any 
displacement d = (N, M), where jV, M are integers. Let gd[n,m) = \g(n,m)—g(n + 
N,m + M)\. From the probability distribution function f'{i,d) = P{gd(n,m) = i), 
with i being the intensity value, several texture features can be derived . 

• Gray Level Run Lengths [10] : This method is based on computing the number 
of gray level runs of various lengths. A gray level run is a set of linearly adjacent 
picture points having the same gray level value. The element r'{i,j\0) of the gray 
level run length matrix specifies the number of times a picture contains a run of 
length j for gray level i in the direction given by angle 0. Several features are 
extracted from the matrices calculated for different directions. 

• Fourier Power Spectrum Analysis [11] : The image is analyzed using the Discrete 
Fourier Transform, which treats the input as periodic. The borders strongly influence 
the spectra as they are treated as abrupt edges. Related with the Power Spectral 
Analysis is the Autocorrelation function. If the primitives are small then the ACF 
will fall sharply. If the primitives are large then the autocorrelation function will 
drop of slowly. Thus the texture coarseness is reflected in the autocorrelation func- 
tion. 

• Laws Approach [12] : Laws approach to texture characterization consists of two 
steps. First microstatistic features are computeed using 3 X 3 or 5 X 5 convolution 
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masks. Second, macrostatistic features are obtained over large windows. Then tex- 
ture energy measures are defined from these convolutions and textures are thereby 
characterized. 

1.2.2 Structural Methods 

Textures with more regular structure lend themselves to structural analysis methods. 

On the structural level, a texture is considered to be defined by elements which occur 

repeatedly according to some placement rules. 

• Methods based on primitive extraction only [13] : Various methods of extracting 
primitives based on gray level thresholding are used. The next step is then to 
measure several primitive features and use them to discriminate between the various 
textures. The texture classification is done using the first order statistics of the 
primitives. 

• Syntactic Approach [14] : This considers that the natural texture results from an 
ideal texture according to some transformation rules. The picture is divided into 
fixed size windows and with some fixed tree structure. A tree grammar is then used 
to characterise the gray tones of each windowed pattern. 

• Edge based approaches [11] : The coarseness of a texture can be represented in terms 
of the density of the edge pixels. Also edge detection is of fundamental importance 
in texture analysis because edges charecterize boundaries and therefore are useful 
for segmentation, object identification etc. The various edge detection tecniques are 
use of gradient operators, compass operators, laplacian operators, detection of zero 
crossing, stochastic gradients etc. 

• Region based approaches [11] : The various techniques used are the clustering, and 
the split and merge approaches respectively . In clustering technique, seeds of dif- 
ferent textures are identified and the region of homogeneous texture is built around 
these seeds. In split and merge, technique the image is split into equal sized blocks 
using the quad tree approach. Based on some property of the probability distribu- 
tion function of the image, further splitting of the image is performed. Subsequently 
similar blocks are merged to get homogeneous textured regions 
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Model based approach [15] [16]; These methods are based on models which were originally 
developed for texture synthesis. They assume some kind of dependence that a pixel has 
on its neighborhood. These models can be based on the linear dependence as in case of 
autoreggresive models or the joint probability density functions with Markov models. 

1.2,3 Multiresolution Analysis 

Though early work on texture analysis was based on statistical and structural techniques, 
a large amount of work is now being done by using methods based on multiresolution and 
multichannel analysis[17] [18] [19]. This is because the traditional techniques were limited 
by the inability to characterize textures at various scales. The study of human vision 
system suggests that the spatial/frequency representation, which preserves both global 
and local information, is adequate for quasi-periodic signals. Since a large no of textures 
can be viewed as quasi-periodic patterns they can be represented by concentrations of 
spatial frequencies and orientations. The wavelet theory has been under intensive study 
in the last few years as a tool for scale space analysis. Coifman, Meyer and Wickerhauser 
[20] have generalized the wavelet basis to include a library of orthonormal bases called 
Wavelet Packets, which permit a very flexible tool for texture analysis. 


1.3 Organisation of Thesis 

In this thesis we begin with a brief review of the wavelet and wavelet packet theory given 
in Chapter II followed by simulation and results of the application of wavelet packet theory 
to texture analysis in Chapter III. Finally in Chapter IV conclusion and scope for future 
work is discussed. 



Chapter 2 

Wavelet Transform And Theory 


2.1 Introduction 

An important problem of image processing is to have a representation that is well adapted 
to extracting the desired information from the image. The extraction of the information 
is done by the decomposition of the image using various transforms. The earliest method 
was the Fourier representation using the complex sinusoids. This was accomplished, by 
the orthogonal properties of the family of the basis functions, obtained from the sine 
and cosine functions. This was not localized in the spatial domain. To overcome this 
problem the Short Time Fourier Transform was used. The wavelet transform like the 
STFT provides localization in both the domains, but also has a further advantage that 
the window size changes with the frequency content of the image. 


2.2 Wavelets 

Wavelet transform of a signal implies the decomposition of a signal with a family of real 
orthonormal bases tpm,n.ix) obtained through translation and dilation of a kernel function 
^(x) known as the mother wavelet i.e. 

■/....(j:) = - n) (2.1) 


5 
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where m^n e Z. Due to the orthonormal property, the wavelet coefficients of a signal f(x) 
can be easily computed by the analysis formula 

/ OO 

( 2 . 2 ) 

■OO 

To recover the signal from the wavelet coefficients, the synthesis formula is 

f(^X^ ^ y (2.3) 

m^n 


2.3 Construction of Wavelets 

To construct the mother wavelet ^(a;), the scaling function (j){x) and multiresolution 
analysis is used. In multiresolution analysis, the space of square integrable functions 
L‘^{R) is decomposed into closed subspaces Vj with the following properties 

• Vj C : The coarser subspace is contained in a finer subspace. 

• flmeZ Kn = 0 : Separation Condition. 

• VimtZVm=L'^{R) ■ Condition for Completeness. 

• f{x)eVm ‘ Scaling Property. 

• There exists a scaling function ^(x)eVo such that 

= 2"'”/^?5'(2~”x - n), m, neZ (2.4) 

• Since (i>{x)eVo C Vi and <f){2x) are a basis for the subspace Vi, the scaling function can 
be written as a linear combination of ^(2x) and it satisfies the two scale difference 
equation [1] 

<|>{x) = ^/2Y.h{k)<f>{2x-h). (2.5) 

k 

The wavelet kernel ■0(x) is given from the the scaling function by the equation 

tf^lx) = V2Y^g{k)^{2x — k) ( 2 . 6 ) 

k 


where 




(2.7) 
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2.4 Wavelet Decomposition 

To perform the wavelet decomposition, a recursive algorithm is implemented. The 
explicit forms of ^(x) and •0(x) are not required as they depend on h(k) and g(k) 
respectively, given by equations 2.5 and 2.6. A J level decomposition can be written 
as 

k{x) = Ylco^k<t>Q,k{^) ( 2 . 8 ) 

k 


+ E/=o where coefficients co,k are given and 

coefficients and at scale j+1 are related to the coefficients at scale 

j by the equations 

C;+/ = ^i,kKk - 2n) (2.9) 

k 

and 

<(?■+/ ,n = ^j,k9{^ ~ '^^) ( 2 . 10 ) 

k 

where 0 < J. Thus equations 2.9 and 2.10 provide a recursive algorithm for wavelet 
decomposition through h(k) and g(k) and the final outputs include a set of J level 
wavelet coefficients , 1 < j < J and the coefficient cj^n for the low resolution 
component cj>j^k{x)- Similarly the recursive formula for the synthesis of the function 
is based on the wavelet coefficients I < j < J and such that 

= X] Cj + i,nHk - 2n) + Y, d.j+t,ng{k - 2n) (2.11) 

n n 

Figure 2.1 illustrates the decomposition given in equation 2.9 and 2.10. The pair of 

filters H and G with impulse response h{n) = h{—n), g{n) = gi—n) are the quadra- 
ture mirror filters, corresponding to the half band low pass and high pass filters. 
Figure 2.2 illustrates the reconstruction procedure implemented by upsampling the 
subsignals q+j and (inserting a zero between neighboring samples) and fil- 
tering with h(Ti) and g(n) respectively, and adding the two signals. The wavelet 
transform decomposition is performed recursively at the output of the low pass filter 
’H’. Thus the wavelet transform decomposes a signal into a set of frequency channels 
that have narrower bandwidths in the lower frequency region. 
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Two Dimensional Wavelet Decomposition. The wavelet decomposition can 
be easily generalized to any dimension n > 0 [2] . Extending it to two dimension 
for image processing, the signal is now a finite energy function f{x,y)eL^{R^). 
Let be the multiresolution approximation of L^{R^). The approximation 

of the signal f(x,y) at a resolution 2^ is equal to its projection on the vector 
space Fgj. Let Vsj be a separable multiresolution approximation of Let 

(f>{x,y) = (f>(x)(l){y) be the associated separable two dimensional scaling function. 
Let t/>(x) be the one-dimensional wavelet associated with the scaling function <f){x). 
Then the three wavelets are defined as 

V>^(x,2/) = 

i^^{x,y) = 

i)^{x,y) = ip{x)^{y) ( 2 . 12 ) 

Just as in the one dimensional case, the wavelet decomposition of a two dimensional 
signal involves convolving the signal with the separablei, two dimensional scaling 
function and three wavelet functions given by equation 2.11. Just as the exact form 
of the scaling and wavelet functions in the one dimensional case was not required 
for the decomposition and the QMFs with impulse response h(n) and g(n) were 
utilized, the two dimensional QMFs filter coefficients are generated as follows 


"■ h{k)h{l) 
hiHikJ) = hik)g{l) 
hfiLikJ) = 
hnniKl) = 9{k)g[l) 


(2.13) 


The two dimensional wavelet decomposition and reconstruction are illustrated in 
the Figures 2.3 and 2.4 respectively. 
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put one row of zeroes between each row 


Figure 2.4: 2D Wavelet Reconstruction 
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2.5 Wavelet Packet Decomposition 

As a natural extension to the wavelet transform theory, Coifman, Meyer and Wick- 
erhauser first proposed a generalization of wavelet theory referred to as Wavelet 
Packet. It is well established that wavelet packets define efficient schemes for repre- 
senting and compressing images. The idea is to construct a library of orthonormal 
bases for function by generalizing the method of multiresolution de- 

composition. The library of orthonormal bases also has time- frequency localization 
properties which can be reasonably well controlled. In the TD case the library 


construction is carried out by considering a quadrature mirror filter h(n). 
surnmable sequence h = satisfying 

Define a 

hn-2khn-2l = h,U = \/2 

n n 

(2.14) 

and let g = gk where gk = 

operators denoted by Fo,iFi 

(— Introducing a summing and differencing 
respectively, we denote : 


FQSk(2,i^ — ^khk—2i 

k 

(2,15) 

and 

FiSk{2i) = Yj^k9k-^2i 
k 

(2.16) 

'Fhe adjoints Fg*, Fj* satisfy 



Fg-Fo + f;Fi = 

= I.FoFo = FiF* = I.FoF,^ = F,F* = 0 

(2,17) 


where the mapping F, defined by F = Fq @ Fi is orthogonal. These two summing 
and differeucing operators are applied to split the functional space. The Wavelet 
transform decomposition is obtained by splitting Vj-i with these operators into Vj 
and Wj and doing the same recursively for Vj. In the frequency domain, the splitting 
operation corresponds to dividing the frequency interval into both the low as well as 
high frequency parts. Hence the wavelet packets allow more flexibility in adapting 
the basis to the time and frequency contents of a function. Thus the decompo- 
sition proceeds as a binary tree which is illustrated in the Figure 2.5. Similarly 
for 2D functions, the analysis functions are given by equation 2.12. The wavelet 
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packet decomposition of a 2D function proceeds as a quad tree, as the decomposi- 
tion is applied to the coarse signal as well as the three detail signals at each stage 
respectively. 

Similar to the summing and differencing operators in the one dimensional case, we 
can define four two-dimensional convolution-decimation operators in terms of the 
QMFs H and G, namely the tensor products of the pair of QMFs as under: 

Fo = H®H 
Fi = H®G 
F2 = G®H 
Fs = G®G 


(2.18) 

(2.19) 


The two dimensional wavelet packet decomposition in terms of the convolution dec- 
imation operators proceeds as a quad tree cis illustrated in the Figure 2.6. The tiling 
diagrams illustrating the various subspaces is shown in Figures 2.7 and 2.8. 








Chapter 3 


Texture Classification And 
Region Identification 


3.1 Concept of Wavelet Packet Signature 

DifF(‘r(uit t<'xtur<\s in an image normally have different power spectral signatures. In 
a wavelet packet decomposition the basis functions are obtained by a translation 
and scale change of the wavelet and scaling functions . Since they are orthogonal 
tht;y remain well localized in scale and spatial domain. The complete wavelet packet 
tree n^prestmt.s the distribution of the signal in the scale space domain. The total 
number of (mc*fficients in a complete decomposition is exactly e<jual to the number 
of points in the original signal. Since the wavelet packet form an orthogonal basis 
their decompositions preserve the energy of the signal at each level. Hence a decom- 
position at any level in the tree of the wavelet packets will have the same energy as 
the signal. Thu.s if the energy of the signal is Eo,o then the decomposition at level 
k will have the energy distribution as 

Eo.o = 'E (3.1) 

1=0 
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i'’igurc 3.1: Fn'fjucncy plane division of the wavelet transform 

'I'hus the energy of the signal i.s distributed amongst the various subspaces depending 
on the fre(}U(‘ncy content of the signal. Since the 2D wavelets capture the orien- 
tation inhjnnation in the various subspaces the energy distribution forms a unique 
identification of the signal. The division of the frequency plane at the first level of 
decutupo'^if ion of the wavelet transform is displayed in fig 3.1. Hence a feature vector 
consisting of a set of energy values obtained from the wavelet packet decomposition 
forms a unique identifying signature of the signal and supports a representation for 
signal classification. For 2D signals the wavelet packet energy signature is obtained 
as an extension of 1 D wavelet packets. In 2D case, the energy of the signal at any 
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Table 3.1: Variance of Scaling functions 


node is disf ribnfefi between four children nodes as given by the equation 


* * njn 


+ bi 


0—1 

^2n+l,2m+l 


(3.2) 


Since orient at ion stdectivity is obtained by the tensor product of the low pass filter h 
and high pa.ss filt<'r g, the energy distributions are computed for the three different 
orient at iou.s. Figure. 3.7 shows the set of frequency channels associated with wavelet 
packi't tran.sfonns for level one and two. 


3.2 Selection of Filters 

To caf)!!!!-*' tht‘ <'U<’rgy of the signal in the various subspaces, it is desirable that 
the w.iv(*!efs tisc'd have higher energy concentrations. Since the wavelet function is 
related to the s<-aling function they would share the same kind of property regarding 
the <-nergy coneentration. Hence the study is confined to the scaling function which 
i.s related to the low pass filter H(z). The energy concentrations of the scaling 
fum tiiui and tlie localization of <j> are determined by the spatial variance of the 

.•icaling function. 


3.3 Spatial Characterization of the 
Scaling Function 

I'hc .spatial variance of the scaling function is studied by the spatial characterization 
of the scaling function, which determines the evolution of ^{x) with respect to x. 
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The crit<>non m.k is introduced to characterize the scaling function ^ spatially. To 
define m*.., the function p{x) is introduced such that 

"" T\ ^{x)l^ dx > 0 and I p(x)d{x) = 1 (3.3) 

rni^ is tlu'n defined as 

"Ik - J i-r-- nil)’' p{x)dx with rrii = J xp{x)dx (3.4) 

I hus Till is etjual to tlie uiatheinatical e.xpectation of p(a;) and corresponds to the 
spatial variant* of the scaling function The quantity m 2 allows us to determine 
th(' energy cuneenf rat ion of (p and provides information on the spatial length or 
localization of 0. I’liis criterion also applies to the wavelet ^.The Table (3.1) has 
the cah'iihitions fur tiu‘ spatial variance of various scaling functions. It is observed 
t hat t lu' Dauiiechies filters have highest spatial variance and thus have better energy 
concent rat ions. Henc<‘ these filters are better suited for texture discrimination based 
on the energy criterion. 


3.4 Minimum Distance Classification 


To test t}u‘ effectiveness of th<i wavelet packet signatures for texture classification 
the miniimun liistance classifier was used . The minimum distance classifier was 
liased on the ,l^c^npf i*>n that each type of texture is represented by a prototype 
of the te.xture. This texture is represented by the energy distribution across the 
waveh't, packet suftspares. 'Fhc unknown texture is assigned to this texture class 
when the ^’.uclide<l^ distance Dk i*> minimum. The Euclidean distance is defined 
by t he equal ion 




iV-1 




(3.5) 


iszQ 


Dk = \\X-Zk\\ 

X represents the feature vector of the unknown texture and Zkik represents the set 
of ijrutotypes of the various textures. The prototype of each class is estimated by 
using the mean of the training sample given by 


Jk= E ||X-Zk|iMc = l,2,...,M. 

X<wk 


(3.6) 
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where M is the number of of texture classes. 

3.5 Classification Algorithm 

There are two approaches to texture clcissification. One is the progressive classifica- 
tion method [[5]] and other is the method of classification using the energies of all 

the subspaces at a given level as feature vectors. 

3.5.1 Progressive Classification 

Learning Phase 

(1) Generate m samples from the given image. Take the image of size ‘1X1’ and a 
window of size ‘nxn’. Move the window over the entire image in steps of ‘k’ to 
get desired number of samples. 

(2) Take the first sample and decompose this sample using the wavelet packet 
transform. Calculate the normalized energy ‘e' of all the children by the equa- 
tion given below: 

^ < ^.0 < « < -^ (3-7) 

(3) Continue till the “stopping criterion” is reached. The stopping criterion is the 
smallest size of the subspace. Usually this is a 16x16 subspace. 

(4) Repeat this process for all the ‘m’ samples of the image. 

(5) Average the energy maps over all the m samples and generate the representative 
an energy map for this image. 

(6) In the representative energy map, at each level of the decomposition discard 
those subspaces which have significantly lower energy compared to the other 
subspaces. 

(7) Repeat the steps for all the images and build a energy map data bank for 
classification. 

central liBRARV 

u. KANPUa 



22 


Classification phase 

(1) Generate the energy map of the unknown image in the above manner. 

(2) Pick up the dominant subspaces at a given level and arrange them in the 
descending order. 

(3) Arrange energy of the images in the the data bank also in a similar manner. 

(4) Discard those images which do not have the similar mapping. 

(5) Calculate the distance measure of the uknown image with the remaining images 
and assign the unknown image to the image with the lowest distance . 

The algorithm is given in the flow chart in the Figure 3.2 and 3.3. 


3.5.2 Classification Using Complete Energy Map 

In the previous algorithm we did not utilise all the subspaces at the given level. 
Only the dominant subspaces were chosen and their energy values were utilised for 
classification. We had assumed that high energy implies a better discriminability. 
This may be true with those images which have their energy concentrated in a 
few distinct subspaces. However a large class of textures exist which have the 
distribution of the signal energy in all the subspaces in a similar manner. Also if 
a large number of textures have the similar energy distribution, more number of 
features will be required for classification. This problem can be solved by using all 
the subspaces at the lowest level of decomposition for building the feature vector. 
Hence another algorithm is proposed, utilising the complete energy. This also has 
two phases as in the progressive cla.ssification algorithm.. 

Training Phase 

(1) Generate ‘m' samples from the given image as explained in subsection 3.5.1. 

(2) Take the wavelet packet decomposition of one sample of the image for all levels 
till the smallest size of the subspace, after decomposition, is 16x16. 

(3) Calculate the normalized energy of all the subspaces at the lowest level by 
equation 3.7. 



BEGIN 


TRAINING PHASE 


Generate 
’M’ samples 
of Image 


Average the energy map| 
over all Samples 
and Build the Image 
Representation 


Select One 
Sample 


All Images Been 
. Analysed 


Wavelet 

Packet 

Decomposition 


Select the 


ConstructNormalized 
Energy Map of Sample 


Next Image 


All Samples been'\^_J 
Analysed ? 


YES 


Figure 3.2: Flow Chart for Training Phase of Progressive Classification 
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CLASSIFICATION PHASE 


Figure 3.3: Flow Chart for Classification Phase of Progressive Classification 
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(4) Repeat this process for the set of given samples and generate the representative 
energy map by averaging the energy map over all the samples. This energy 
map is the feature vector for the given image. 

(5) Build the feature vector for all the given images in a similar manner. 
Classification Phase 

(1) Take the unknown image and calculate its wavelet packet decomposition. 

(2) Form the feature vector of this image by calculating the energy of all the 
subspaces at the lowest level. 

(3) Calculate the distance for this image with all the given images in the data bank 
using the minimum distance classifier in equation 3.5. 

(4) The image is assigned the class with which it has the minimum distance. 

The complete energy map classification is explained in the flow chart in Figure 3.4 
and 3.5 


3.6 Implementation for Single Textured Images 

In a large no of references dealing with the texture analysis [5], [10], [13], [18], images 
were chosen from the Brodatz album of Textures. Due to the non availability of 
the album, synthetic textures with the desired orientations were generated. Since 
the algorithm proposed is for textures with distinct directional orientations, the 
generation of synthetic textures gives the freedom to generate the textures .with 
the orientations which can be captured by the wavelet bases. A set of ten images 
were synthesised with distinct directional orientations. Then a set of 65 samples 
were taken from each image, by selecting different regions from the image. The 
procedure followed is is similar to that used in Multispectral image processing. In 
the present method Fifty samples per image were utilized for building the class 
prototypes,in the Training phase.The fifteen samples were used as the test images 
to implement the classification phase.Both the algorithms were implemented. The 
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Figure 3.4: Flow Chart for Complete Energy Map Classification 
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CLASSIFICATION PHASE 


Fiffure 3.5: Flow Chart for Classification Phaise of Complete Energy Map Classification 
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h(0) 

.48296291 

h(l) 

.8365163 

h(2) 

.22414386 

h(3) 

-.129409599 


Table 3.2: Daubechies 4-tap filter wavelet coefficients 


implementation was done using the Daubechies 20-tap and 4 tap filter. The wavelet 
and scaling functions of both these filters are displayed in Figures 3.8, 3.9, 3.10, 3.11 
respectively. The coefficients are given in table 3.2 and 3.3. The energy plots for all 
the image prototypes are given in Figures 3.12 to 3.21. 


3.6.1 Results 

Having implemented the progressive classification and complete energy map classi- 
fication algorithms for single textured images, following are the observations. 

(1) Since the progressive classification algorithm uses only the dominant subspaces 
for classification it had a larger error of classification when the number of 
feature vectors were few. For only two or three selected dominant subspaces 
it gave very poor results. As the number of features in the feature vector were 
increased the classification rate improved. This is displayed in the plot in the 
Figures no 3.22 and 3.23 Though the Daubechies 4-tap filter is only marginally 
inferior to the 20-tap filter, it needs analysis with a larger no of texture samples, 
to come to a definite conclusion. However , since the Daubechies 20 tap filter has 
a higher energy concentration, it will have better discriminability for textures 
using the energy criterion. 

(2) The algorithm using the complete energy map gave classification errors at level 
one and two. But at level 3 with 64 features and level 4 with 256 features 100 




h(0) 

0.0266700679005473 

h(l) 

0.1881768000776347 

h(2) 

0.5272011889315757 

h(3) 

0.6884590394534363 

h(4) 

0.2811723436605715 

h(5) 

-.2498464243271598 

h(6) 

-.1959462743772862 

h(7) 

0.1273693403357541 

h(8) 

0.0930573646035547 

h(9) 

-.0713941471663501 

h(lO) 

-.0294575368218399 

h(ll) 

0.0332126740593612 

h(12) 

ir '-'-VsTO 

h(13) 

-.0107331754833007 

h{14) 

0.0013953517470688 

h(15) 

0.0019924052951925 

h(16) 

-.0006858566949564 

h(17) 

-.0001164668551285 

h(18) 

0.0000935886703202 

h(19) 

-.0000132642028945 


Table 3.3; Daubechies 20-tap filter wavelet coefficients 




percent classification was obtained. Also though the number of features are 
more, computationally it is not time consuming. Hence we can derive 100 % 
classification using this method. 

(3) The wavelet transform decomposition is inferior in classification to the wavelet 
packet transform because a fewer no of features are availabel at any level of 
decomposition compared to the wavelet packet decomposition. Also the images 
with same energy in the higher frequencies will have the same energy map with 
the wavelet transforms. Hence these images will not be discriminated correctly. 


3.7 Region identification and Classification 

In many of the segmentation techniquesi, the textured images are differentiated 
into regions of different textures using various techniques both spatial and spectral. 
However the region identification and classification does not take place.A technique 
to carry out region identification and classification is proposed using the wavelet 
packet transforms. The wavelet packet decomposition decomposes the image across 
the scale, while preserving the spatial locations of different regions. Also the energy 
in each subspace at every level is obtained from the contributions of the energies 
of the textures present in the image. Each texture contributes the energy in those 
subspaces where its orientations are represented. Thus, if the dominant subspaces 
of a particular texture presented in the image are selected from the data bank 
and the image is reconstructed from its decomposition, with the chosen subspaces 
only, the region containing that texture is reconstructed and the rest of the image is 
suppressed. Subsequently to classify the region the reconstructed region is extracted 
and classified using the minimum distance measure with the stored textures as 
discussed in section 3.5. The procedure for region identification is enunciated. 

(1) Build the data bank of energy distributions of various textures after taking the 
wavelet packet decomposition of the images. 

(2) Take the wavelet packet decomposition of the given image. 



(3) Choose a texture from the databank and identify its dominant subspaces using the 
energy criterion. 


(4) Having chosen the dominant subspaces at a given level of decomposition for the 
chosen texture from the data bank, these subspaces are used to reconstruct the 
image from its decompositon. 

(5) Extract the reconstructed region of the image and carry out classification of this 
region. 

(6) If the image is classified incorrectly then repeat the procedure 

(7) Check the classification once again. 

This is enunciated in Figure 3.6. 


3.8 Image Rescaling 

To enhance the extracted region the region is rescaled by rescaling the wavelet packet 
coefficients at the corresponding spatial locations at the desired resolution. For the 
purpose of explanation we will assume that the picture is a function of two variables 
supported in the region [0,l]x[0,l].Let (n,m,k) be the index of an amplitude in the 
complete wavelet packet expansion of a picture S. Here m=0,l,...,l i.e. the no of 
levels and 0 < n < 4"". We rescale the image by replacing c(n,m,k)with c(n’,m’,k’) 
for a restricted range of k’s.The map n to n’ etc determined by the rescaling. For 
example, if n’=2n and m’=mH-l, then we will increase the magnification locally with 
little change in the frequency content. 


3.9 Results and Discussion 

The process of region identification and classification was carried out with two tex- 
tured and three textured images with distinct directional orientations. Since separa- 
ble wavelets were used selectivity in three directions could be obtained because each 
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detail image corresponds to directional edges in horizontal, vertical and diagonal 

directions. The various observations are 

(1) In two textured images since there were two partitions with distinct directions, 
the segmentation and reconstruction was distinct. 

(2) Though only the dominant subspaces are chosen, the reconstructed portion 
of the desired image was classified correctly. Though the resolution of the 
reconstructed potion of the image is poorer,compared to the original image, 
it is still adequate for correctly identifying the different regions. 

(3) In the three textured images also the regions were correctly classified. To 
ensure that the undesired portion of the image was not reconstructed the 
dominant subspaces common to the undesired texture were dropped and region 
identification and classification was then carried out. This process has to be 
done judiciously, since dropping of the common subspaces may result in the 
desired portion of the image losing a large amount of its details. 

(4) The results of the above described method are shown in the Figure 3.24 to 
3.27. 

(5) Though we concentrated on distinct orientations, this algorithm can be used 
for arbitary textures also. Since we used orthonormal wavelet bases, choice of 
the type of wavelets, does not influence the algorithm, for region identification 


3.10 Highlights of The Proposed Method 

It is observed that the wavelet packet transform provides a good analytic tool for 
texture analysis. Till now in the multiresolution analysis of textures wavelet trans- 
forms or Gabor Transforms were used, which were suitable for textures with energy 
concentrated in the low frequency. The wavelet packet transform is more suitable 
and effective for textures with dominant middle frequency channels. In the multires- 
olution analysis the features are extracted using the transforms and subsequently 
feature vector analysis is done using KL transforms for feature space reduction. 
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These methods either carry out segmentation or classification. In the proposed 
method a combination of the two has been attempted with a simple algorithm. 
Since most of the textures energy characteristics would be known apriori , this 
method is simple. With more and more powerful computational techniques being 
now available, implementation of the proposed algorithm will not be difficult. 
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Chapter 4 


Conclusions 


Directionality is an important characteristic of the texture. Though various sta- 
tistical and structural techniques have been in use for a long time, multiresolution 
analysis, using wavelet decompositions, is proving to be very effective in texture 
analysis. In this work the use of wavelet packet transforms for texture classifica- 
tion of single textured images, region identification and classification for two and 
three textured images with distinct directional orientations was investigated. For 
classification, two algorithms were studied. One was the progressive classification 
algorithm and the other complete energy map classification. Due to the multi reso- 
lution capability of the wavelet packet transforms we can concentrate on the desired 
frequency locations and carry out the texture classification and identification. The 
texture locations were also changed to observe the performance for region identifi- 
cation. It was observed that the region identification was still done. Also since the 
wavelet packet transforms carry out scale space decomposition for both the low as 
well as high frequency components of the image they have better discriminability 
unlike the wavelet transforms which concentrate only on the low frequency portion 
of the signal. 
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4.1 Suggestions For Future Work 

There is tremendous scope for future work in this field. 

@ The texture classification using the entropy criterion can be investigated. Already 
the entropy criterion is used for coding by the best basis selection of wavelet 
packet subspaces. 

@ The Two dimensional separable wavelet packet transforms give the discrim- 
inability in three different directions. By using the non -separable wavelet 
transforms and hexagonal wavelets a larger number of directions can be iden- 
tified. This will given greater choice of texture discrimination. 



Bibliography 

[1] J. Daubcchics, ‘‘Orthonormal Basis Of Compactly Supported Wavelets” Com- 
municntions on Pure and Applied Math,Vo\ 41, no 7, Oct 1988 , pp 909-990. 

[2] S. G. Mallat , “A Theory For Multiresolution Signal Decomposition” , IEEE 
Trans on Pattern Analysis and Machine Intelligence , Vol II , No 7 , July 1989 
, pp 674-693 . 

[3] Olivier Rioul and Martin Vetterli , “ Wavelets and Signal Processing ” , IEEE 
SP Magazine.” , Oct 1991 , pp 14-38. 

[4] “ Special Issue On Wavelet Transforms ” , IEEE Trans, on Information Tech- 
nology , Vol 38 , No 2 , Mar 1992 . 

[5] 'rianhorng Chang and C.-C.Jay Kuo , “Texture Analysis and Classification 
with IVee-Structured Wavelet Transform” , IEEE Trans on Image Processing , 
Vol ”, No 4, Oct 1993 . 

[6] R. M. Haralick , “ Statistical and Structural Approaches to Texture ” , Proc 
IEEE , Vol 67, May 1979 , pp 786-804 . 

[7] R. iM. Haralick, K. Shanmugam and I. Dinstein ,“ Textural Features for Image 
Classification” , IEEE Trans System, Man., Cybernetics , Vol SMC-6 , 1976, 
pp 269-285. 

[8] L. S. Davis, M Clearman and J. K. Aggarwal , “An empirical evaluation of 
Generalized Cooccurrence Matrices ” , IEEE Trans Pattern and Machine In- 
telligence , PAMI-3, No 2, 1981 ,pp 214-221. 


50 



51 


[9] R. W. Conners and C. A. Harlow , “ A Theoretical Comparison of Texture 
Algorithms ” , IEEE Trans Pattern and Machine Intelligence , PAMI 2 , No 
3 , 1980 , pp 204-222 . 

[10] M. M. Galloway , “ Texture Analysis Using Gray Level Run Lengths ” , Com- 
puter Graphics Image Processing , No 4 , 1975 , pp 172-179 . 

[11] A. K. Jain , “ Fundamentals of Digital Image Processing ” , Englewood Cliffs 
, NJ: Prentice Hall , 1979 . 

[12] L. Van Gool, P. Dewaele and A. Oosterlinck , “ Texture Analysis Anno 1983 
” , Computer Vision Graphics and Image Processing , No 29 , 1985 , pp 336- 
229 . 

[13] F. Tomita , Y. Shirai and S. Tsuji , “ Description of Textures by a Structural 
Analysis ” ,IEEE Trans Pattern Anal, and Machine Intelligence ” , PAMI-4 , 
No 2 , 1982 , pp 183-191 . 

[14] S. W. Zucker , “ Towards a Model of Texture ” , Computer Graphics Image 
Processing , No 5 , 1976 , pp 190-202 . 

[15] P. de Souza , “ Texture Recognition via Autoregression ” , Pattern Recognition 
, 15 , No 6 , 1982 , 471-475 . 

[16] R. Chellappa , “ Two Dimensional Discrete Gaussian Markov Random Field 

Models for Image Processing ” , Pattern ^ Vol 2 , 1985 , pp 79-112 


[17] A. C. Bovik , “Analysis of Multichannel narrow-band filters for Image Texture 
Segmentation ” , IEEE Trans Signal Processing , Vol 39 , Sept 1991 , pp2025- 
2043 . 

[18] C. Bouman and B. Liu , “ Multiple Resolution Segmentation of Textured Im- 
ages ” , IEEE Trans Pattern Anal, and Machine Intelligence , Vol 13 , Feb 
1991 , pp 99-113 . 

[19] A. C. Bovik , M. Clark and W. S. Geisler , “ Multichannel Texture Analysis 
using Localized Spatial Filters ” , IEEE Trans Pattern Anal, and Machine 
Intelligence , Vol 12 , Jan 1990 . 



52 


[20] R. R. Coifman and M. V. Wickerhauser , “ Entropy-based Algorithms for Best 
Basis Selection” , IEEE Trans Information Theory , Vol 38, March 1992 , pp 
713-718 . 




E£' - m- PRA - RE<^ 



